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Abstract 
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r~| ' In this paper we consider the maximum principle of optimal control for 

"j^ ' a stochastic control problem. This problem is governed by a system of fully 

coupled multi-dimensional forward-backward doubly stochastic differential 
equation with Poisson jumps. Moreover, all coefficients appearing in this 
I system are allowed to depend on the control variable. 

■ We derive, in particular, sufficient conditions for optimality for this 

■ stochastic optimal control problem. 
OS ■ 

MSG 2010: 60H10, 93E20, 60G55. 

O 

■ Keywords: Poisson process, maximum principle, optimal control, forward- 
backward doubly stochastic differential equation, adjoint equation. 

> : 

H ■ 1 Introduction 



Forward-backward stochastic differential equations (FBSDEs in short) were first 
studied by Antonelli in jlj, and since then they are encountered in stochastic 
optimal control problem and mathematical finance. For example, Xu in [T7j 
studied a non-coupled continuous forward-backward stochastic control system. 
Then Wu, [IS], studied extensively the maximum principle for optimal control 
problem of fully coupled continuous forward-backward stochastic system. Peng 
and Wu, [7], considered fully coupled continuous forward-backward stochastic 
differential equations with random coefficients and applications to optimal con- 
trol. A method of continuation is developed there. Shi and Wu in [9j studied 
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the maximum principle for fully coupled continuous forward-backward stochastic 
system, but the forward diffusion does not contain the control variable. 

Fully coupled FBSDEs with respect to Brownian motion and Poisson process 
were considered by Wu in [16] and Yin and Situ in [12] . Such equations have been 
shown to be very useful for example in studying linear quadratic optimal control 
problems of random jumps, and also to handle nonzero-sum differential games 
with random jumps. The work of Wu and Wang in [14j is useful in this respect. 
In [1] the authors investigated stochastic maximum principle for non-coupled 
one-dimensional FBSDEs with jumps. Meng, [2], considered an optimal control 
problem of fully coupled forward-backward stochastic systems with Poisson jumps 
under partial information. More generally, Shi in [S] provided recently necessary 
conditions for optimal control of fully coupled FBSDEs with random jumps. 

Backward doubly stochastic differential equations were first introduced by 
Pardoux and Peng in [5]. They gave a probabilistic representation of quasi linear 
stochastic partial differential equations. In 2003, Peng and Shi [6] introduced fully 
coupled forward-backward doubly stochastic differential equations (FBDSDEs in 
short). Such equations are generalizations of stochastic Hamilton systems. Exis- 
tence and uniqueness of the solutions to (continuous) FBDSDEs with arbitrarily 
fixed time duration and under some monotone assumptions are established. Then 
the authors provided also a probabilistic interpretation for the solutions of a class 
of quasilinear SPDEs. In this respect we refer the reader to [H] for an application 
of fully coupled FBDSDEs to provide a probabilistic formula for the solution of 
a quasilinear stochastic partial differential-integral equation (SPDIE in short). 
On the other hand, another application can be found in [10], where the authors 
studied the maximum principle to find existence conditions for optimality for 
a stochastic control problem governed by a continuous forward-backward dou- 
bly stochastic system in dimension one. These are some examples to show the 
importance of studying FBDSDEs. 

In the present work we shall consider a discontinuous situation by adding also 
a random jump to the forward and backward equations, and study, in particular, 
a stochastic control problem where the system is governed by a nonlinear fully 
coupled multi-dimensional FBDSDE with jumps as in the following system. More 
precisely, we shall establish sufficient conditions for optimality in the form of a 
stochastic maximum principle for this kind of systems. 
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Our system under study is the following: 

dyt = b(t, yt, Yt, Zt, Zt, h, Vt)dt + cr(t, yt, Yt, Zt, Zt, h, Vt)dWt 
+ /q ip(t, yt, Yt, Zt, Zt, kt, vt, p)N{dp, dt) - ZtdBt, 

< dYt = -f{t,yt,Yt,Zt,Zt,kt,Vt)dt~ g{t,yt,Yt,Zt,Zt,kt,Vt)dBt i^-^) 

+ZtdWt + jQkt{p)N{dp,dt), 

, Vo = Xo,Yt = hiyr), 

where b, a, ip, f, g and h are given mappings, {Wt)t>o and {Bt)t>o are independent 
Brownian motions taking their values respectively in and in M™, while v. 
represents a control process and N{dp, dt) is the compensated Poisson random 
measure associated with a Poisson point process 77. Here T is a fixed positive real 
number. 

We shall be interested in minimizing the cost functional 

J(u)=E[ / eit,yt,Yt,zt,Zt,kt,vt)dt + PiyT) + l{Yo)], (1.2) 

over the set of all admissible controls (to be described in Section [2] below). 

We close this section by pointing out that such fully coupled FBDSDEP in 
order to provide a probabilistic formula for the solution of a quasilinear SPDIE, 
as will be seen in Example 13.31 in Section [3l 

The paper is organized as follows. In Section [2], we formulate the problem and 
give various assumptions used throughout the paper. In Section [3] we introduce 
the adjoint equation of (11. ip . state our main theorem and give an example to 
illustrate this theorem. Section H] is devoted to proving the main result. 

2 Formulation of the problem and assumptions 

Let (f2, J-", P) be a complete probability space. Let {Wt)te[o,T] and {Bt)te[o,T] be 
two Brownian motions taking their values in M'^ and W respectively. Let 77 be 
a Poisson point process taking its values in a measurable space (9,i3(6)). We 
denote by i^{dp) the characteristic measure of rj which is assumed to be a a- 
finite measure on (9,i3(0)), by N{dp,dt) the Poisson counting measure (jump 
measure) induced by r] with compensator u{dp)dt, and by 

Nidp, dt) = N{dp, dt) - u{dp)dt, 

the compensation of the jump measure A^(-, ■) of r]. Hence iy{0) = K[N{0, 1)] 
for O G B{Q). We assume that these three processes W,B and t] are mutually 
independent. 
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Let denote the class of P-nuU sets of J^. For each t e [0,7"], we define 
Tt :— V Tfrj, V where for any process {ttj}, we set 

r:^^ = aiTTr - TT,; s < r < t) VAf,:F^ = ^l^. 

For a Euchdean space let A4^(0, T; £■) denote the set of jointly measurable, 
{T'tj-adapted processes {Xt-,^ e [O, T]} with values in E and such that 

E[ / \Xtf^di\ < 00. 
Jo 

Similarly, denote by <S^ (0, T; £") to the set of cadlag, { J^t}-adapted processes 
{Xf, t G [0, r] } with values in E, and satisfy: 

E[ sup l^tl^l < 00. 
o<t<r 

Let Ll(W^) be the set of jB(0)-measurable mapping k with values in M"* such 
that 

lll^llh= [/ \k{p)\l^i^{dp)Y^ < 00. 

Je 

Denote by J\f^{0, T; W^) to the set of {j;}-adapted processes {Kt, t e [O, T] } 
that take their values in Ll(MJ^) and satisfy 

E[/ / \Kt{p)\lrr.i^idp)dt] <oo. 
Jo Je 

Finally, we consider 

:= (0, T; M") x (0, T; W) x (O, T; M"^') 

X A^^ (0, T; M"'^'') X A/J (0, T; M™) . 

Then is a Banach space with respect to the norm \\-\\^2 given by 

IICIIm2 

:=E[sup \yt\^ + sup |^t|^+ / / / | ||/ct|| |^ (it] , 

0<t<T 0<t<T Jo Jo Jo 

forC = iy;Y.,z.,Z.,k.). 

Let [/ be a non-empty subset of R". We say that f. : [0, T] x Q ^ is 
admissible if v. e M^{0,T;R"-) and Vt e U a.e., P — a.s. The set of admissible 
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controls will be denoted by Uad- Consider the following controlled fully coupled 
FBDSDE with jumps: 

dyt = b{t, yt, Yt, Zt, Zt, Vt)dt + a{t, yt, Yt, Zt, Zt, h, Vt)dWt 
+ /q ip{t, yt, Yt, Zt, Zt, kt, vt, p)N{dp, dt) - ztdB^ 
^ dYt = -f{t,yt,Yt,Zt,Zt,kt,Vt)dt- g{t,yt,Yt,Zt,Zt,kt,Vt)dBt (2-1) 

+ZtdWt + J^kt{p)N{dp,dt), 

, 2/0 = Xo,Yt = Hyr), 
where the mappings 

6 : X [0, T] X X M"' X M"^' x W""^ x Ll{W) xW ^ W, 
a : 1] X [0, T] X M" X M™ X M"^' x M x Ll{W) xW ^ W"^, 

: X [0, T] X X X M"^' x M™^'^ x Ll{W^) x x ^ M", 
/ : X [0, T] X M" X X M"^' x M™^'^ x L^(M™) x -> R"", 
c/ : X [0, T] X X M*" X M"^' x M x L^(M™) x M" ^ M™^', 
/i : X M" -> M"^, 

are measurable (further properties to be introduced later in this section) and 
V. e Uad- Given a full-rank m x n matrix R of real indices, we assume that h is 
defined, for (a;, x) E fl x M", by h{u!, x) := c Rx + ^(a;), where c 7^ is a constant 
and f is a fixed arbitrary element of L^(f2, J-'t, P; M*"). 

Note that the integral with respect to dB is a "backward" Ito integral, while 
the integral with respect to dW is a standard "forward" Ito integral. We refer 
the reader to [3] for more details on such integrals, which are particular cases of 
the Ito-Skorohod stochastic integral. 

A solution of (12.11) is a quintuple {y, Y, z, Z, k) of stochastic processes such 
that {y,Y,z,Z, k) belongs to and satisfies the following FBDSDE: 

yt = Xo + /o b{s, ys, Ys, Zs, Z^, ks, Vs)ds + a{s, y,, Y^, z^, Z^, ks, Vs)dWs 
+ /o /e ^Z'*-' ^s-, z„ Z„ ks, Vs, p)N{dp, ds) - z^dB^, 

Y {t) = h{yT) + j\ f{s,ys,Ys,Zs,Zs,ks,Vs)ds ^ 

+ g{s,ys,Ys,Zs,Zs,ks,Vs)dBs 
- ZsdWs - /e h{p)N{dp, ds), te [0, T]. 

Define the cost functional by: 

J{v.):=E[[ i{t,yt,Yt,Zt,Zt,kt,Vt)dt + ^{yT) + j{Yo)], v.eUad, (2.2) 
Jo 
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where 
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n X [0, T] X M" X X R"^' X W""^ x L2(R") x M" ^ 



are measurable functions such that fl2.2p is defined. 

Now the control problem of system (12.11) is to minimize J over Uad- In this 
case we say that u. G Uad is an optimal control if 

J{u.) = inf J{v.). (2.3) 

Let us set the following notations: 

C = {y, Y, z, Z, k) G M"+^'»+'^x'+'»x'i X L2(M™), 
A{t,<:.v) = {-R*f,Rb,-R*g,Ra,Rip){tX,v), 

(AC) = -{y,R*f) + {Y,Rb)-{z,R*g) + {Z,Ra) + {{k,R^)), 

where 

= iR*gi---R*gi),Ra = iRa,---Rad),..., 

{{k,Rip)){t,C,v) = f {k{p),Rip{t,C,v,p))i^{dp). 

Je 

The following assumptions will be our main assumptions in the paper. We 
shall mimic similar assumptions from the literature (e.g. [10]) for this purpose. 

• (Al) VC= (z/,l',;z,^,A;),C= (y,>^,^,^,A;) gM"+™+"^'+™^''xL2(M^'"), 
Vt G [0,T], Wv G U, 

{Ait, C, v) - A{t, C,v),C-C)< -K\Riy -y)f + \Riy~y)\' 



and 
or 

(Al)' 



+ \\R%z-z)f+\\R%Z-Z)\\+\\\R*{k-k)\ 



c> 0, 



{A{t, c, v) - A{t, c,v)x-o> i^mv -y)\ + \R{y - y) 



rr\ 1 2 



and 



+ \\R\z-z)\\^^\\R\Z-Z)\\+\\\R*{k-k)\ 



c < 0, 



where /i is a positive constant. 
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• (A2) For each C e M"+'"+"x'+™x'i x LliR""), A{-, () is a predictable process 
and A(-,0) G Wf. 

• (A3) 

(i) The mappings /, 6, g, cr, £ are continuously differentiable with respect to 
{y, Y, z, Z, k) and [3 are continuously differentiable with respect to y, 
and 7 is continuously differentiable with respect to Y, 

{ii) the derivatives of f,b,g,a,(f with respect to the above arguments are 
bounded, 

(zn)the derivatives of i are bounded by C(l + \y\ + |y| + ||2;|| + \\Z\\ + |||A;|||), 
(iv) the derivatives of /3 and 7 are bounded hj C {1 + \y\) and C (1 + 
respectively, 

for some constant C > 0. 

Remark 2.1 The condition c > in (Al) guarantees the following monotonicity 
condition of the mapping h: 

{h{y)-h{y),R{y-y))>0, Vl/,yGM^ 

The same thing happens also for c < in (Al)'. 

The following theorem is concerned with the existence and uniqueness of the 
solution of (ED). 

Theorem 2.2 For any given admissible control v and under the assumptions 
(A1)-(A3) (or (Al)', (A2), (A3)), then l[2l\) has a unique solution. 

Our assumptions in this theorem satisfy the assumptions of the corresponding 
result in [TT], so the proof of this theorem can be gleaned from [llj . 

3 Adjoint equations and the maximum principle 

Let u. be an arbitrary element of Uad and {y, Y, z, Z, k) be the corresponding 
solution of f l2.ip . Suppose that (Al)-(A3) hold. We want here to introduce first 
the adjoint equations of the FBDSDE (12. ip and then present our main result of 
the maximum principle for optimal control of our system with jumps (12. ip . To 
this end, let us begin by defining the Hamiltonian H from [0,T] x M" x x 
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j^nxi ^ j^mxd ^ i2^]^m^ X M" X R" X M" X M"^^ X R'"^^ X LI{R"') to R by the 
formula: 

H{t,y,Y,z,Z,k,v,p,P,q,Q,V) := {pJ{t,y,Y,z,Z,k,v)) 

- (<?, ^) 2;, Z, k, v)) + {P, g{t, y, Y, z, Z, k, v)) 

- {Q, o-(t, y, Y, z, Z, k, v)) - i{t, y, F, z, Z, k, v) 

- [ {V{p),^{t,y,Y,z,Z,k,v,p))u{dp). (3.1) 

Now the adjoint equations of the FBDSDE with jumps (12. ip are 

dpt = Hydt + HzdWt - PttSt + /q HkN{dp, dt), 
dqt = Hydt + HjiBt + QtdWt + /e Vt{p)N{dp, dt), (3.2) 
Po = -7y (^0), qr = -c Rpr + Pyiyr), 

where Hy is the gradient VyH{t, y, Y, z, Z, k, v,p, P,q,Q,V),... etc. Let us say 
some thing more about this system (13. 2p . 

Theorem 3.1 Under (A1)-(A3) there exists a unique solution [p, P,q,Q,V) of 
the adjoint equations liS. 2\) (in M?) . 

Proof. This system (13. 2p can be rewritten as in the following system: 

' dpt = ifrPt - byqt + gyPt ~ cryQt - Jq ^*yVt{p)u{dp) - ey)dt 

HfzPt - hUt + g*zPt - cy*zQt - /e '^'^zVt{p)^{dp) - £z)dWt - Pt&t 
+ UfkPt - Kit + 9lPt - alQt - vlVt{p)v{dp) - QN{dp, dt), 

< dqt = if^pt - blqt + g*yPt - a;Qt - i^*yVt{p)p{dp) - ly)dt ^ 

+{f:Pt - Kqt + gtPt - KQt - le V*MpMdp) - QtSt + QtdWt 
+ j^Vt{p)N{dp,dt), 

^ Po = -7y(^o), ?r = -c Rpr + Pyivr), 

which is a linear FBDSDE with jumps. Here fy is the gradient 
^yfit,y,Y,z,Z,k,v),... etc. 

Thanks to assumptions (Al)-(A3) the result follows from Theorem 12. 2[ ■ 

Now our main theorem is the following. 

Theorem 3.2 Assume that (A1)-(A3) hold. Given u. E Uad, let {y,Y,z,Z,k) 
and (p, P, q, Q, V) be the corresponding solutions of the FBDSDEs ^2.1\) and ^KM) 
respectively. Suppose that the following assumptions hold: 
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(i) [3 and ^ are convex, 

(a) for all t G [0, T], P- a.s., the function H{t, •, •, •, •, •, -jp, P, q, Q, V) is concave, 
(Hi) we have 

H{t, yt, Yt, Zt, Zt, h, ut,pt, Pt, qt, Qu Vt) 

= maxH{t,yt,Yt,Zt,Zt,kt,v,pt,Pt,qt,Qt,Vt), (3.3) 

for a.e, P - a.s. 

Then {y.,Y., z., Z., k.,u.) is an optimal solution of the control problem Ii2.1\) - 



The proof of this theorem will be established in Section HI Now to illustrate 
this theorem let us present an example. 

Example 3.3 Let (e,i3(G)) = ([0, 1], -B([0, 1])). Let N{dp,dt) be a compensated 
Poisson random measure, where {t, p) G [0, 1] x [0, 1]. Recall that E[A^((ip, dtY] = 
v{dp)dt is a finite Borel measure such that J^Q^p^i'{dp) < oo. Let the controls 
domain be U = [—1,1]. Consider the following stochastic control system: 

dyt = (1 + t)vtdt + {-Zt + Zt + kt + vt)dWt - zJWt - Vt J^^ ^ pN{dp, dt), 

dYt = -it - A)vtdt - lizt + Zt + h + Vt)tBt + ZtdWt (3.4) 

+ 4y h{p)N{dp,dt), 
L 2/0 = 1^1 = x G M, tG (0,1), 

where W, B are Brownian motions in R, and W, B and N are mutually indepen- 
dent. Consider also a cost functional given for v. G Uad by 

J{v.) = \ ^[j\y^t + Yt + + Z^t + k^t + v^t)dt\ + \^[yf\ + \^[Y^] . (3.5) 

We define the value function by 

J{u*) = inf J(u). (3.6) 



v.eu, 



ad 



This system I!i3.4\ ) can be related to the one in ^2. 1\) by setting the following 
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mappings: 

Hyt) = yt, i.e. c = 1,^ = 0, 

ip{t, yt, Yt, Zt, Zt, kt, Vt, p) = -VtP, 

h{t, yt, Yt, Zt, Zt, kt, Vt) = (1 + t)vt, 

fit, yt, Yt, Zt, Zt, kt, Vt) = {t- A)vt, 

3 

g{t,yt,Yt,Zt,Zt,kt,Vt) = -{zt + Zt + h + Vt), 

a{t,yt,Yt, Zt, Zt, kt,vt) = {-zt + Zt + h + Vt), 

i{t, yt, Yt, Zt, Zt, kt, Vt) = ]^{yl + Y^ + z^ + Z^t + + ^')- 

One can see easily that assumptions (Al), (A3) (and of course (A2)) are ful- 
filled for this system. Thus Theorem \2.S\ guarantees the existence and uniqueness 
of the solution of Ili3.4\ ). In fact Ili3.4\ ) is a fully coupled linear FBDSDE with 
jumps. 

Now letting u. = 0, we find from the construction of FBDSDEs with jumps 
(as for instance in ITlf) that the corresponding solution (yt, Yt, Zt, Zt, kt) of Iji3.4\ ) 
equals {x, x, 0, 0, 0), for all t G [0, 1]. 

Next notice that the adjoint equations of ^3.4^ are 



(3.7) 



dpt = -Ytdt + ilPt -Qt- Zt)dWt - PtdBt 

+ j\o,SPt-Qt-kt)N{dp,dt), 

dqt = -ytdt + (fPi + Qt- zt)tBt + QtdWt + ^ Vt{p)N{dp, dt), 
^ Po = -X, qi = -cpi + Pyivi), t e (0, 1), 

if we recall that 

Po = -IriYo) = -7y(a;) = -x, 

Pt = Po — / Ytdt = Po — X dt = —X — xt = —x{l + t), 
Jo Jo 

Here we used the fact that pq is deterministic. Hence pi,qi are deterministic 
since: 

pi = -2x, 

qi = -cpi + (3y{yi) = -pi + (3y{x) = 3x. 

It follows that 

Qt = Qi + ytdt = 3x + x{\ — t) = x(4 — t). 
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In particular, {pt,qt, Pt,Qt,Vt) = (— x(l + t), x(4 — t), 0, 0, 0) is the unique 
solution of Ij^S. 7| j. These facts show that the Hamiltonian attains an explicit for- 
mula: 

H{t, yt, Yt, zt, Zt, kt, v,pt, Pt, Qt, Qt, Vt) = Pt{t - A)v - qt{l + t)v 
3 

-l^Pt{zt + Zt + kt + v)- Qti-zt + Zt + kt + v) 

- [ V pVt{p) uidp) - hy^ + + + zl + k\ + v") 

^[0,1] ^ 

= + - 4)t; - x(l + t)(4 - t)v - ^v^ - - ^x^ 

= — — x^, V G U. 
2 

Hence 

H{t, yt, Yt, Zt, Zt, kt, v,pt, Pt, qt, Qt, Vt) - H(t, yt, Yt, Zt, Zt, h, Ut,pt, Pt, qt, Qt, Vt) 
= - ^v"^ -x^ + + x^ = < 0, Vw e U, a.e t, F - a.s. 

As a result, condition (Hi) of Theorem \3.^ holds here for u. = 0. Furthermore, 
all other conditions of Theorem \3.2\ can be verified easily. Consequently, 

{y.,Y.,z.,Z.,k.,u.) = (x,x,0,0,0,0) 

is an optimal solution of the control problem Ij^3.4\ )- f37^) . 

For more applications of the theory of fully coupled FBDSDEs particularly in 
providing a probabilistic formula for the solution of a quasilinear SPDIE we refer 
the reader to [llj, P. 15]. 

4 Proofs 

In this section we shall establish the proof of Theorem 13.21 Let us recall first the 
following lemma. 

Lemma 4.1 (Integration by parts) Let (a, a) G [5^(0, T; M")] ^ ^) e 
[M\0,T;R'')]\{j,j) G [M\0,T;R'''"')]\{6,6) G [A^^^O, T; R"^'^)] ^ and 
{K,K) G [f^^{0,T;W)]\ Assume that 

at = ao+ [ Psds+ [ -fsciBs+ [ 6sdWs + [ [ Ks_{p)N{dp, ds), 
Jo Jo Jo Jo Je 
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and 



at = ao+ I /3sds+ / %dBs+ / S^dW^ + / / K,ip)N{dp,ds), 



^0 ^0 ^0 ^0 




forte [0,T]. Then 



"T j-T j-T 

(ot, St) = (ao, So) + / {at.dat) + / {dat,at) + / d{a,a) 



t ■ 



E[(aT,«T)] =E[(«o,ao)] +E[ / {at.dat)] +E[ [ {dat,at)] 

Jo Jo 

-E[ [ {^t,lt)dt] +E[ [ {6tX)dt] +E[ [ [ {Kt,KMdp)dt]. 
Jo Jo Jo Je 

This lemma can be deduced directly from Ito's formula with jumps (see e.g. 

my 

We now prove Theorem 13.21 We start with two lemmas. 
Lemma 4.2 Under (A1)-(A4) we have 
Av.) - J{u.) > E [ {qr, y^^ ' Vt) ] + E[ {c Rpr, - yr) ] - E [ {po, Y^- - Yo) ] 
+ E[ [ {e{t,y^-,Y,^-,z",-,Z';;-,kl,Vt)-e{t,yt,Yt,zt,Zt,h,ut))dt]. (4.1) 



Proof. Let v. be an arbitrary element of Had- Denote by {y^' , Y""' , z^' , Z^' , k^' ) the 
corresponding solution of (12. ip . We have 

J{v.) - J{u.) = E[/3(2/^-) - ^{yr)] +E[^{Y,^-) - 7(^0)] 

+ E[ [ {eit,y^-,Y,^-,z:,Z:,k^-,vt)-iit,yt,Y,,zt,Z,,h,Ut))dt]. 
Jo 

Since (3 and 7 are convex, we obtain 

/9(?/t)-/5(?/t)>(/3,(i/t),?/t-?/t), 
^{Y-)-^{Yo)>{MYo),Y--Yo), 

which imply that 

J{v.) - J{u.) > E[{l3y{yT)ST - Vt)] +E[{^y{Y,),Y^- - Y,)] 

+ E[ [ {i{t,y^-,Y,^-,z:,Z:,k^-,Vt)-i{t,yt,Y„z„Z„k„Ut))dt]. 
Jo 
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From the adjoint equation (13.11) and system (12.11) . we have 
Po = -IviYo), qt = -c RpT + Pyiyr)- 

Thus dUD holds. ■ 

The following lemma contains duality relations between (12. ip and (13. 2p (see 
the equivalent equations in the proof of Theorem 13. ip . 

Lemma 4.3 Suppose that assumptions of Theorem \3.S\ (in particular (A1)-(A3)) 
hold. Then 



E 



E 



Jo 



(po, Y^- - Fo) ] = -E [ (pT, Y^' - Yt) ] 

[ {pt, fit, yl , , zl , Zl , kl , vt) - fit, vt, Yt, Zt,Zt,h, ut)) dt] 



+ E 




- E 



Jo 



/ {Pt, git, yl , Y^- , zl , Zl , , Vt) - git, yt, Y^, z^, Z„ fc„ Ut)) dt] 




+ E 




{Hkit, yt, Yt, zt, Zt, kt, ut,pt, Pt, Qt, Qt, Vt) 



klip)-ktip))yidp)dt\, (4.2) 



and 




- bit, yt, Yt, Zt, Zt, kt, ut))dt] 



+ E[ / {Hyit, yt, Yt, Zt, Zt, kt, Ut,pt, Pt, qt, Qt, Vt),yl - yt) dt] 



Jo 



+ E[ / {H,it,yt,Yt,Zt,Zt,kt,Ut,pt,Pt,qt,Qt,Vt),Zt' - Zt) dt] 



+ E[ [ {Qt, ait, yl , Y^- , z^ , Z^ , k^ , Vt) - ait, yt,Yt,Zt, Zt, h, Ut)) dt] 



+ E[ / / lytip),^it,yl ,Yl- ,zl ,Zl ,kl ,vt,p) 



Jo Je 



- (pit, yt, Yt, Zt, Zt, kt, Ut, p))uidp)dt] . (4.3) 
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Proof. Applying Integration by parts (Lemma I4.ip to {pt,Y^' — Yt) gives 



{pt, fit, yl , Y,"- , zl , Zl , kl , vt) - fit, yt, Y^, z^, Z„ h, u^)) dt 
{pt,{git,yl,Y,^-,zl,Zl,kl,vt) 

-git, yt, Yt, zt, Zt, h, Ut))tBt) 

+ 11 {puiK{p)-Up)))Nidp,dt) 

Jo Je 

+ ^ {ptAZl -Zt)dWt)- (y,-' -Yt,PttBt) 

+ / {HYit,yt,Yt,Zt,Zt,kt,Ut,Pt,PtAuQt,Vt),Y^^- - Yt) dt 
Jo 

+ I - Yt, Hzit, yt, Yt, Zt, Zt, h, Ut,pt, Pt, Qt, Qu Vt)dWt) 
Jo 

+ [ [ {Y^^- - Yt, Hkit, yt, Yt, Zt, Zt, h, Ut, 
Jo Je 

Pt,Pt,qt,Qt,Vt))Nidp,dt) 
{Pt, git, yl , Yl , zl , Zl , k\- , vt) - git, yt. Yt,zt, Zt, h, Ut)) dt 



+ / {Hzit,yt,Yt,zt,Zt,kt,ut,pt,Pt,qt,Qt,Vt),Z^- - Zt)dt 
Jo 



'0 

'0 Je 




{Hkit, yt, Yt, Zt, Zt, h, ut,pt, Pt, qt, Qt, Vt), 

klip) - ktip))pidp)dt. 



Now by taking the expectation to the above equahty, we obtain (14. 2p . 
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{qr, Vt -yT)= I {qt, b{t, , F,- , z^' , , , Vt) 
Jo 

- bit, yt, Yt, zt, Zt, kt, Ut))dt 

+ / {qt,{a{tSt\Y,^-,zl,Zl,kl,Vt) 
Jo 

- a{t, yt, Yt, Zt, Zt, h, ut))dWt) 

+ 11 {y"t -yuVt{p))N{dp,dt) 
Jo Je 

'qt, {zl - zt)tBt) + / {yl - yt, QtdWt) 





+ / / {qt,{^{t,yl,Y:-,zl,Z:,kl,Vt,p) 

Jo Je 

- Lp{t, yt, Yt, Zt, Zt, kt, ut, p)))N{dp, dt) 

+ (yl - Vt, H^{t, yt, Yt, Zt, Zt, kt, Ut,pt, Pt, qt, Qt, Vt)(iB^ 

+ / {Hyit, yt, Yt, Zt, Zt, kt, ut,pt, Pt, qt, Qt, Vt), yl - yt) dt 
Jo 

+ / {H^{t,yt,Yt,Zt,Zt,kt,Ut,Pt,Pt,qt,Qt,Vt),zl - Zt) dt 
Jo 



+ / {Qt,ait,yl,Yl-,zl,Zl,kl,Vt) 
Jo 

-a{t, yt, Yt, Zt, Zt, h, Ut))dt 

+ 11 {Vt{p),^{t,yl,Yl-,zl,Zl,kl,Vt,p) 
Jo Je 

-ip{t, yt, Yt, Zt, Zt, kt, Ut, p))y{dp)dt. 



By taking the expectation to this equality (14. 3p holds. ■ 

The remaining is devoted to completing the proof of Theorem I3.2[ 
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Proof of Theorem 13.21 Observe first from (13.11) that 



i{t, yl , Y,^- , zl , Zl , k\- , vt) - i{t, yt, Z^M. ^t) 

= - {Hit, yl , , z^- , Zl , kl ,vt,pt, Pt, qt, Qt, V^) 

- H{t, yt, Yt, zt, Zt, kt, ut,pt, Pt, Qt, Qt, Vt)) 
+ {pt, fit, yl , Y^- , zl , Zl , kl , vl) - fit, yt,Yt,zt, Zt, ul)) 

- {qt, bit, yl , Yl- , zl , Zl , kl , Vt) - bit, yt, Yt, Zt, Zt,kt, Ut)) 
+ {Pt, git, yl , Yl- , zl , Zl , kl , vt) - git, yt, Yt,zt, Zt, h, ut)) 

- {Qt, ait, yl , Yl- , zl , Zl , kl , vt) - ait, yt, Yt, Zt, Zt, h, Ut)) 

- f {Vtip),vit,yl ,Yl- ,zl ,Zl ,kl ,vt,p) 

- ^it, yt, Yt, Zt, Zt, kt, Ut, p))uidp). (4.4) 



e 



Next apply Lemma 14.21 Lemma 14.31 and (14. 4p to find that 



Jiv.) - Jiu.) 

> E[ / {Hyit, yt, Yt, Zt, Zt, kt, Ut,pt, Pt, qt, Qt, Vt),yl - yt) dt] 
Jo 

+ E\ [ {Hvit, yt, Yt, Zt, Zt, h, Ut,pt, Pt, qt, Qt, Vt),Yl- - Yt) dt] 
Jo 

/ {H^it,yt,Yt,zt,Zt,kt,Ut,pt,Pt,qt,Qt,Vt),zl - zt) dt] 
Jo 

I {Hzit, yt, Yt, Zt, Zt, kt, Ut,pt, Pt, qt, Qt, Vt),Zl - Zt) dt] 
Jo 

{Hkit, yt, Yt, Zt, Zt, kt, ut,pt, Pt, qt, Qt, Vt), kl (p) - ktip))vidp)dt] 

■ r {Hit,yl,Yl-,zl,Zl,kl,Vt,Pt,Pt,qt,Qt,Vt) 
Jo 

- Hit, yt, Yt, Zt, Zt, kt, ut,pt, Pt, qt, Qt, Vt))dt] . (4.5) 



+ E 
+ E 
+ E 
- E 




'0 



On the other hand, from the concavity condition (ii) of the mapping 



iy, Y, z, Z, k, v) ^ Hit, y, Y, z, Z, k, v, p, P, q, Q, V) 
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it follows that 

- H{t, yt, Yt, zt, Zt, kt, ut,pt, Pt, Qt, Qt, Vt) 

< {Hy{t,yt,Yt,Zt,Zt,kt,ut,pt,Pt,qt,Qt,Vt),yt - yt) 
+ {Hyit, yt, Yt, Zt, Zt, kt, Ut,pt, Pt, Qt, Qt, Vt),Y^''■ - Yt) 
+ {H^{t, yt, Yt, Zt, Zt, kt, ut,pt, Pt, qt, Qt, Vt),Zt - Zt) 
+ {Hz{t,yt,Yt,zt,Zt,kt,Ut,pt,Pt,qt,Qt,Vt),Zl - Zt) 

+ / {Hk{t,yt,Yt,Zt,Zt,kt,Ut,Pt,Pt,qt,Qt,Vt),k't{p)-kt{p))iy{dp) 
Je 

+ {H^{t,yt,Yt, Zt, Zt,kt,ut,pt, Pt,qt,Qt,Vt),Vt - ut) . 
In particular, 

- {Hy{t,yt,Yt,Zt,Zt,kt,Ut,pt,Pt,qt,Qt,Vt),Vt - Ut) 

< {Hyit, yt, Yt, Zt, Zt, kt, ut,pt, Pt, qt, Qt, Vt),yt - Vt) 
+ {HY{t,yt,Yt,zt,Zt,kt,Ut,pt,Pt,qt,Qt,Vt),Yl'' - Yt) 
+ {Hz{t, yt, Yt, Zt, Zt, kt, ut,pt, Pt, qt, Qt, Vt),zl - zt) 
+ {Hzit,yt,Yt,Zt,Zt,kt,Ut,Pt,Pt,qt,Qt,Vt),Z^' - Zt) 

+ / {Hk{t,yt,Yt,Zt,Zt,kt,Ut,pt,Pt,qt,Qt,Vt),k^{p) - kt{p)) u{dp) 
Je 

- [H{t, yl , Yl , z\- , Zl , kl ,Vt,pt,Pt,qt, Qt, Vt) 

- H{t, yt, Yt, Zt, Zt, kt, Ut, Pt, Pt, qt, Qt, Vt)]. 

Now by applying this latter result in ( 14. 5p we obtain 

J{v.) - J{u.) > -E[ / {H^{t,yt,Yt,Zt,Zt,kt,Ut,Pt,Pt,qt,Qt,Vt),Vt 
Jo 

On the other hand, the maximum condition (iii) yields 

{H^{t,yt,Yt, Zt, Zt, kt,ut,pt, Pt, qt,Qt,Vt),Vt - ut) < 0. 
Hence (I4.6P becomes 

J{v.) - J{u.) > 0. 

Since u. is an arbitrary element of Uad, this inequality completes the proof if we 
recall (Q- ■ 



- Ut) dt] . 
(4.6) 
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